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(54) STEREOSCOPIC VIDEO IMAGE GENERATOR AND ITS METHOD USING MPEG DATA 
(57)Abstract 

PROBLEM TO BE SOLVED: To generate a stereoscopic video image from 
two video images by extracting a motion vector of I P. B pictures from an 
MPEG bit stream so as to generate another video image. 
SOLUTION: An image extract section 100 extracts image data from MPEG- 
coded data and a motion vector generating section 110 generates a motion 
vector in response individually to a macro block in an image consisting of 
the image data and gives the motion vector to a motion vector field 
configuration section 120. An image storage section 160 stores about K 
sets of images consisting of the image data and a motion stereotype 
decision section 1 30 uses the motion vector from the motion vector field 
configuration section to decide a motion stereotype in response to a 
current image. A stereoscopic image generating section 140 uses a 
preceding image and a motion stereotype in the image storage section to 
generate a synthetic image in response to the current image and outputs 
both the images. A left/right side image decision section 150 decides the 
current image to be either of a left side image and a right side image of a 
stereoscopic image and decides the synthesis image to be the other image. 
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ShfcLHfcHfc® J: o £$ti>3>*i£ (SPS9 10), 
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gOSKip&O, :&:£B£fiSiR3i7.4*£ttl ) 
5*{Siai!Rt/%*£*{l!Bittl 0 ) 



1 1 02fcfe^T3S«S«J4-iJ^«i« <Priiiary De 
cision Area ; BT. PDAktM-*) fcZgcKEffltf (S 



HJtffciaW* <PDA) ami 2£^2iX?Z±W 
mfgi&ZtS^XimmftMtTlVl. (l-r)MO X [rN 
y, (l-r)Ny] *»V*fc*»C* 9 . ZJttfaQW (SD 
A)U(tNU (l-r)Nx]x [TTfe. (l-v)HyMHtt' 
"C*4. rlcDKffllilO.O. 0.5]K3Tt4. PW»iri.* 
7*»«fe£U snATli*^5aiffli*3I»*»i&f 

•yfCD^V}**-? YjU£M±*COtt*. 0«M»» IE 
LTV\4. mSl lOSlZ&^Xti&kt*) 

RHtTi (811 104). Z0Xm*:*ti?ti?V 
ACOh PMMJ. PDA(2)c5£#>4. C«ttftlitt3'??Q 
7*D?*©«U:S— C2&*. PDAtOL PDAIlL PDA(2) 

105). i*<0, 1, 2h Wi»l*flfctT*3a.V 

■itv&ti. zcrMmmT&gi 1 1 2.fctfwc« 

fcch.4. 'BUI 1 06C£VvrSBfeBqa»*L*. % 

#, a * v t 7 1 smm* «aj£t*s&A*Bv •• 

^■7 h'unm&ftcoft^efrsi-z, {mi io 
6) . <K^T*<V84v>{m. ow^ommRifiE?) 



(10) 32 001-16609 (P2001-16 6JL 



$p»ow*iwm-*. (m 1107). znm.im 

A(0). SDA(lh SDA(2)t«fe*. iflfe<Od%SDA(i«) 
$• B&V xtgk 0 O 2 fltt 5 3>-#^gO «0 £ jgtf SDA(j 
*)fcg*S (JgWl 108) . >£JfS22iTtli:Je«56. 
g2:^£-|^>fcg9<0Z^3^«B&O#V^ 

IR^t h . ftASMVi* 2^(S]*W*31!jC J: him 

6. <JM>J:'3«CM6*fl»BLfc.-»lfc, SSl^HQfcSS 
2*HUC»T4«»«tt»r SttUiaoat*fc J: OH* 

sn* (mi in). 

(0021) 
[»16] 



Tsua 



. spAfn 

SDAt/J 



^2fc, SDA|%0*¥E8S(rNx. (1-r ) ftdttfeWC 
ffiMOT^flHIffSDtt (Sltil 0 9TWK) com 

rcttmi 1 1 oTawwtttBvvctwsitti' 
mi7] 

id, 

<r soa 



fct>»2*l*ll4JB33ST*JteJ: OSt^x^ii*. f&2:fr 
rtltf •♦' (£flB») »i;frlW '-' C£ 

fflflB) ftlf*2*rtl# '0' (ffjttfJB) ^^tfct- 
FAaWBUHU FB<flB*h.*. * 

jfeMwarsiK- * 540 iimgmmwwTmtVi 

£Zti1Mf±im&Zik&tZ. Hi 3fcjft**ifcSft 
HfcJBWCBW*-*. SPgl 3 0 0C*SVV£\ ^>^fc 

»«M»»t*twifsnwar. hi logssi i o 

■ 13 01). #>53Ii&*fifci£0#±**{i3ttv 
?a?u<y OT13 02) . J&>5ffl& 
^^-fi^a -7^ o/d -/ ^ fcfiH— ^jrjEtfO (positiv 
e> teO^uT'o-y^liOOB^** 
$€4 (SKI 3 03) . fW?s ??nyo. y ^ii 
0^^fe{iffS<0€OiEO^Sr*-f B^gJJ 
fc-v^D7'o-^* { * 3 F»l6$i't(g®1309) ., 
8Mtii&!£i8.i!tl& (SKI 3 10) . S&13 0 0& 

vapi 1 3 o 4 c j: vtiS7im±imTZ *) . 

• 0Wm**tl (§©1 3 0 5) . SKl3 0 9T?i 



1 0-?*jS*»J: LT4«RlfllttJS*i*. SHI 30 
O&lfflHfl 3 0 4 J: >5!t«t:OSe)t*LT-*> 

mtgZim*? b/HWEL (SKI 3 06) . 
jEStfc®* 1 ^? hfr*nZ>iZ#>3i-si; (edge) fMfeffi. 
^4. SPH3 0 7C*JV^T-7^DyD-yJ7<0x.yi;^r 

1 ) ii*7lffi&Z®fr&Wfr\ffll l^&Pil 1 0 5 

Z^hjUffiEth. ■y^OT'Dv^MB (nl, n2) CO 
K^^^h/^^^^fcaa^iJJlltrMB (nl-K 
n2) Olfit^^ WHEWES&iS. MB (nl+1. n2) « 

2) ^^oyn-y^rx^^ipT?:^^^*. 01 
4C^LJt5a^^Tej7^;^Sr^. ^0/07? 

^>-t>fX{ii6xi 6rfc«^ mizmtotiKw 

7o -y fn^ite&ttm^h .. -7 if ■of n -vino 

■WUfTK T2. T3- T4tCfeV^T JI F*(i^Sr^*T« 
< ;w> trJBWltf x -y iWiWW fcft* . fie-o 

T, *-7^D7'0-y^(if^X-yyMB2lI/X-y>''MBTJ>o. 
Tx.yi^B«x-yv^lSlar*-t&. S£x -y 



E-?(?)7?D/D -y i> T-X -y i?^Tft£*f &X y ^"7^ 

3) t*vma'\imm®^wit®w?&fik&h 

5. i->T. 5»^H&*464^liJilHav^n7'o«y^ 
cr>m<?hfrZ%&-tZ>. aKl3 0 8-C<ii&&<> 

(norm) dMB££#>4. S6&^^ h/KO^/U^JiiXOjS 
[002 2) 

(SIS) _^ 

(0023) • 
(gfl 9] 



(11) S2 001-16609 (P2O01-16 6JL 



{0024) 
[8c2 0] 



[0025] 
«t211 

r^-C, MAX (dMB) <i^ft€^-5^ffii^?S=&a«W)V 
0. &PI1 3 0 8£fcl>Tff#3ft*X"/->*£f8V-'.*St 

[0026] 
[»22] 



^ICL-C, fftt (ah n2) fc:?rf 4-??o:7o>y (nl 
-1 % n2-i) ^^^nyov^S^X-yi^TSKOH 
•Chi. $mitx.'vi?%fi<om/ s Omke>l, 4 5K3r 
<5>l/2. 9 0JK«:/5 0-Cfe5. (tttfS<0£& 
X-^htyfih. H«te, 8Wl3 0 9tJ:9"MWai; 

18 1 3 1 0 ) . -&£!£3gS«*5BiaS5 5 0(i3EB£@ 

.sis izTfiZixfzt^mzgmvxmm- - 

5 0 0). JilffilimiiSPgl 5 0 4T«fcii*. B®^ 



ftffl-ts (SKi 501). ^vvettassftir^a:/ 

Oy?^^? b/t^&tffcLH (S 

pgl5 02) . COLHffi{3i:"ISS^DyQ-y^^7j« 

(gpgi 503). *?mmtit???vy 

Oy?tgi§l 5 0 0d^ajif?iTJtmB«5-^^r 
h (SRf 1 5 04). £-j£»ih®«?S£«5 3 OteiHfi 

#®«2r£j£t£. 01 5fc^£ix£SE*iEI£fllV'>Tijl 

(S&150 0) . /WVAAttKK 2 5 5)<0 

-f l^l't»MIKIB»5»«f* (SKI 5 1 0 ) « 
HB3MBW* 6 £tf> , SMW*** WS#»§ AM** 
£<•§•*.. ftv«E*Sfl!«***ar<*i:4 (fiWl 5 
0 2). ^ffiSrffl^TJEf 4*W»=»art- 5 
( BW 1 5 0 3 ) . J: "5#-77 n^o y ? 

^★TfWLT^iaWK&W-* (8W1-504) . 
£/*MW68J£il 15 0 l*&{HM£jft8 1 4 O iOffi 
Sl*»fe*l2*V»L*4JCiH8Lfc35atfflv»TfflinMll 
£=&fflS«£&5£-f4 . SSRWUSm* 1 6 OttWieL 
fc J: 'j Ci#=®«^:«s 1 4 04>£j£M9ft£<c49Rr 



If. JSUnHUMHI 160 ft<7)$fo£ffiS£ futBfctt 
m<%l. DAC170. 18 0{i£/£ffi!lB«&5t$l 

t::^& LT r -r *T W > n* -/ 7 r (05r£-f ) iz-RStf 
i»M#&gfc$:4. 

[«»^]-JJLB6^!:J:9fc*5»Ht=J:ixtf. MP 
Lx4B{&tefi3<0±#B«2:&J£-f & i t (c J: 0 . 5 



PEG-2HDTV, MPEG-2DVD7V— MP 
E G-lt'r*C D*^fc»V»Ti#«WnTKfe4 0 . 
MPEGfcJSWOvfrUNTSC TV. VCR&iffc 

ft*. 

[0 1 ] *H#^a* LV-^MSti: SMPEGf- 

[H2 J h;W*^«0piffl : 5:1iJtSrSH-7'D'y 

[03] iB&-??Q'7n-y?{:;£&&BBfcv?o:7' 
□ •y^^Sfaer^tST?)*. - 
[04] IBff=<0i!)#^^^^•9E7&t4)tft^^^^i^i^ 

[05] Si^^S5XI/^B^^comE^S! 
it*5rf 7*P -/ j?0TS S . 

[07] * J Fl!ffl^i^7jc?Sj^®5r^^-4S^0t l 
£>4. 

[ 08 ] ifeteK^^gf^fr^ c ft^k^^ft x c ffMBii 



(1 



[B9] ffiOM*^*SftOT&ft; 

[31 0] *&mm^*kVM^b*Mk 

[011] *TI^*i#^««^435J6oaft 
il0T£>6. 

[014 ] x^^ra^^^^etfflv^^ii^ifi]^ 
[015] ]!5SI6^^A*tt«fc^i-S^^SStL 

[01] 



) 12 001-1660 9 (P 2 0 01-16 6 JL 



0T2>£. 

[01 6] Sf±^rA»^t:S^r^^S^^ft0 
100 p«»ffig& 

1 1 o Yn&sm 

120 " 

i 3 o mgmvm 

140 4#B«£j£35 
1 5 0 2£/*{Kril«ft5gS5 

150 mmufftm 

170, 180 DAC 
[04] 



100 



no 

ft* 

££3 



120 
S__ 



130 



140 



Sift U 



150 



an 

*?IE3 



1 — 1 n 





160' 



[02] 



[03 ] 



200 
i 

A* WW 



210 

L_ 



220 
< 




239 

( 


BBTftft* 










hit 


BR8S 







— 5 — 

•240 



25C 



12-^ MEDt.y.k-n 
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IH7) 



130>a._ 



l»i>64-»> 



500 
\ 


610 




520 
















ft** ■ 




MSB 





TO 



3 



ssmm 



c 



J 





-J- 
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/ 




£30 


540 


. 550 


500 





700 



710 



140' 



740 




720 



730 



[H6] 



cre>TV 



~- 600 



^4?D7D 9 ^©eifcW«8)t»JI I 610 





( 1 4 ) !2 0 0 1 - 1 6 6 0 9 ( P 2 0 0 1 - 1 6 6 JL 



•[39) 



[010] 



900 



910 



SO 



940 





[Bin 



C ■» ) 



1600- 



1601- 



1602- 



16C3- 



1604- 



1 






> 


r 




1 


r 






t 




I 







•i 





( g ) 



==aSE35ff»== 



Titoo. 



saws 



1102 



t103 



11 



1108 



0t5ff*JS»<PQAX[U). 





1107 



It* 



1105 
1111 

i 



1106 



1112 N 



1110 
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[012) 




[B13] 



1300 



1301 



( «» D 




31 



. -4 ■ 



1307 



-4" 



J- 



.1305 



("**» ) 1S16 

♦ 
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114) 





□D 



1500 



tS04 



Zl 



1501 
T / 



1502 



1503 



[!fiiJB) :s TOl2:£9.Hl4B (2000. 9. 1 
4) 

[#®ME1] 

ri«E^) 

■titwri) i . Bsj/PmmmmtxhiMPE 

UGH**? h/td^zm&^gfc^Sii^IJ^ 



[|ft*JB2 j I . B&1S pw&#mtx hi M P E 



(1?) 32 001-16609 (P2001-16 6JL 



(o^-^mm-r immune . 

«. iggm*<»M^gfrfe*ft*tiAflgfts 
area i fcieM<p:ft.tt«agja«. 

3ifeli&c0£ft-7 ? p7p -y 7 feOTE«n«fc 

a. 



f nasi 7 i wEfctt«ME&ft#«tt» ^.ggtjihBi^ 

Vvca^MJg«iBBW±B«fc^g*lfefe» 31 

iSrkMt* * 7iSilrfr tfel fcl§]fcV:?P:/P-y?i:*3T 
^V^»oro-y»OlBT«IMI^IMr*J: 

■y g&tmffigflUa-ygPT'P'y 

wear? »p7p -y »fc»B**»JW***>Tttg 



fcfe. a^g fl*ft»ranhv *p:rp»?ott»*»)> 
*»fcfe£JttU 

safety mc^A\z^&cn±m^&^SL. 



q^MT»v^ntamka^.g^<i»fcti»i ^ 



(18) S2001-16609 (P2001-166X 



ii*OT9) mmiimt. man&-*wm 

UT&StVh*fU-A»tt£»»LTI. P. Bin 

rats* i o i snag i jm\±. mmzMi&M& 

[ft ot 1 1 1 Tineas i xaa. mp.ttffigfifeg« 
gr£#PBjg o£r££&£a& ££Bgg=fjg 

oTVifr Vvy» p^p* ? lCttLTtt*HBtttt»aBL 
•Cttg*y?P: fP»»g)B*^M,ft3lB6. airfX-V 



tj0)&32 P7"p -y 7 wEB ii<fe<7)-?? oy 

^z-#je^&m2^. &if«iatgttg-?»p:rp» 
.ritCT 1 5 1 fgfgmsxsiig fete. a&»«kP+ 



im&emmmz&izth z > zv&b-tz . wot 



? T^-V v-7 ^ p^p -y r? oBfcjBgttfeaft 4 J: 3 tcSU 

< fc— m y ^'7^ pyp y ^Atf jatiBflky? • 
?P!/P-y:70ti)g^:7 h^^V^Tafe-y^.P^Py 

[BTOT19] J?|g^M^g» Sg^«ar^a.S 



(19) 120 01-1 6 60 9 (P2O0 1-16 6JL 



flBOTI2.il fFE^gttto^g^SfcJ:^TAflt 

M area ftfeaBffiBaroMft^i^^RmMtTfc 



VY?£{|dftft (stereoscopic image) 5-±E£-f isIS. 
lf*ffifc*'3. #CMPEGtf-/h*H;-i»T*I, 

3 l&^'«S-^T-tfcOBj^J:')1f«S#utSt*>!fe 

[0002) 

jty (stereoscopic camera) ?:MVyiJ\ MPEG— 1 
CD. MPEG- 2 HDTV, MPEG-2 DVD* 

*«flgg);»ftfci'. MPE<3*«3A»fHc*»V*T^ 
[0003] *%egzp'^^S% fc S i^l^SfDn 

3*4. MP£Gfl»-*T4*WMK:£lM- 
tXh. . 

[0004)*^ijfcg^ix*S£*9g««:, B*<0 

=»-(S^)-«arBHttfc«lElfi» (Modified Ti 
m Difference : OT r MTDj fc«rf i ) t 



[0001] 



tcJ: DWIStifcMTDiSM:, 1 ) IKfRttSaffiU 
2)tt*05£Kai£fr[6l*fcJtU 3) f£B)#o££R 

lay direction) SXfiSEttfiB (delay time) 

-ft&KflM delay image) JplrVfftHQl 

[000 5) (ft) oHn?rx^sm«ii 

«*WBI***i£ttx 1) yDv^JB»««U 

2 ) -y ^ k^^^ hfrcr>-*M xz%m l. 3)mz 

•MBWsMPWBU 5) *W»$^ya. y ^S>* 
[0006] 

Tjdiafe&2illM^^f&ljL ^M^lra (ba 




(00 0 7}Z£g?<&) fcAPaggft^-Wfett. 
B9£3 :TDy ?Q7ttW«»<a ««fcJ: S^P-y ink. 

[00 0 81 g-aT. B?&LftH:g^-fr&frMPEGfr 

(decoded) ttBHCglfiTOTM (motion prediction) 

(pictures) ffiRSft LT&&MPE GjfriHEgftftT-* 
^t^TiftWB (stereoscopic imam) 

z&s.mtmrth m 1 aw . msftmrxivfrm* 

fc> »l*»fc«VvCttttgft£li»<»V^fraivr 

[ 0 0 0 9 3 BS8 Lfc3^JUPfltoBMfraWE-<-.&*>tf> 
OAftWa4= Jafe»*» I. BMXPlifefoicturesltf 

JTOLT&*MPEGfiFgfrgft.fcy--»EjmvriHfc 

jSfeg (stereoscopic image) ££$-r&^gtcj3lvC. tHT 

h;^^t/te&#gfc&i&g ftaM-r- Agra 
fflKB fHBirafc*mgft^ira«»r/ft ft 

gftfegraB^ffl*vr3!iagttfc^&-frrt.ig«»f 
f o o i o ) imnnt*.* h>istk&-n&%-t*-cn^m 




20) 82 001-16609 (P2001-16 6JL 



OPWayvy^ feftttLTI. P. BMtttHiL. S- 
LTItt <^ hflo? * P (notion vector field) y 

roo 1 1 1 ^cir. Bg«&tfPB«^)iit»<yMir 

lirf S7kT3a&(horizontal aotlon)Sfe > 2Sj.r/Sii^gD 
»^fc»« Kftst ffi otion)g^<7)j^,V^Tfjij^ — otz 

[0013] ^-r. wwaaam t*jkw*y m 
[ o o 1 4 1 £c:t. BflWMnMBiMbk^Biiftwa 

- gg^ gj ^ g lf ^j^, 5 ) g | ^^SQ j ^ft^^p 

[ o o 1 5 1 ^ ^ r-. jgjg(^ ggsgs»a;3aaBig«k 

fry j-frKfrfttfLT. Bfeg)#ttr7?p 

[ o o 1 6 1 «> ae<oA«fc«wt^a^BBi. n ±w&k& 

[0 01 7) uCT, ^iftk ^g^g^. 
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iftfrffifcigt?:?P:/a-y?k*3T^ivy?P:A2-y 

2 settle i ~>x afflux » 2zl 2 cat 

(0019) 3KMiiftfcftliSf*UfcSttB 

pyp y lam**.* hJt>tabfaky8aMnq«> 
[ o o 2 o ] ^ it. ^^raiBiBai t atggfcteagai 

t o o 2 i i wa<pfe/fcMi«rafefr^tf*o*itt 
■tt»m'iitee««fctt2&3aMfc»BiT; gift 

^-FAsfra^-KBg&iE-f3>.I>ffg£U->. 

i o o 2 3 ) c«B8<osaegss)£rr. usHHt* 



[0024 ] Hi teHKBoa* 4 M 
PEQEEttT-^OA{WJMfti«SatT*S. BIG* 

110, WK^-^fMliJS&l 2 0, §»JB 

S&£S130, £#Sg&£S140, £/£18»f6 

jfcgguso, ctinnttM»i6 0s *ltdac 

(Digital To Analog Converter) 17 0, 180 

it, 

(0025) WH*US«1 0 OaMPEQtir VXYV 
tr^^-Ny?" (pictureheader) rt<03 t'y 

Bft0Bfta8**l6«* fcOT. «i» 3 t'-y h 3- 
FjtF0 01&6B"IWtCfc9, 0 1 0=5:*>PIi«, 1 
0 0**BB«V**. WttSMH lOaMPEGV 

ffi*r-^r»*<^ b>U£j£Sl 1 oRi*mwm 

(0026] 10141, P, B® 

-y 9 <TMt-^9 V-A* b*-y h.X MJ— 

fcOVvca^B^*-*fc#SILTlMi<<* 

IWMi-f ^4^**i-*fcit)ll 

[0027] MPEGtf^iStcAflSft&GOP^Sfc 
f0028) . ■ ■ Bp Bi P, B; B„ [g B« B, 

Pa Bo Bi n Pi i . . • 

. [0029] . . . Po Bp Bj la. B a B, P 

p B7 Pi 1 Be Bt n ... 

tfWteJavYCBs t b 4 it 1 5 *«v^TaowattT' 
wi; p, bw&z>t<! xy'i' 4 WftT=i-?xJ) 
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to 


B 


B 


P 


B 


B 


I 


B 


B 


P. 


B 1 


B 


P 


B 


B 


P 


B 


B 


0 


1 


2 


8 


4 


5 


6 


7 ' 


& 


9 


10 


11 


12 


18 


14 


16 


16 


(b) 


P 


B 


B 


I 


B 


B 


F 


B 


B 


P 


B 


B 


P 


B 


B 


I 


B 


2 


0 


1 


5 


3 


4 


6 


6 


7 


II 


2 


14 


14 


12 


13 


17 


15 



[0030} Mfettaa i o otcfewr B gteff&ms 

BW<m%*7 V)V2&®2 1 Ofi, m&Zti*:-??* 

[0031] Bwmt. n-ft?)®*^? Wl^TL-O* 

0. MteGOPfc&ini/PS&fcPiifciOEJg 
(distance) X'kZ. M=3 tW^ttlX. S HD(a) 
tCfeWC. Bal i. Jtfrfo^SJSftiPjzJifc-- o^ffl 

10 0 3 2) 

'mi j 

rati 3fc*t>--^3/^B iL <9t&S-'^ WW±<fcoi 

[0033} 
(S2) 

[0034} b mffiSte^? M<£jiS« 2 i OfcJt^r 

p -y ? e »Cfr*B**g fjUi BMMMt ^ h ;148 
^2 2 0Cte&$rl..Eiol&£'<.? h;U7-f-;>K 
WOU '20AA:A3*U>.- .PWtfcWMJJFililtf. 
?m®W:tf<? h/ltttttf 2 4 0JibVh;*. h 'J - AT 



MigSI§e-®i»i^S^fcJ6fcPlii«<o«^ 

[0035) 
[»3) 

U*,d£' = -feu,,.*,} 

[0036) sti^^r-/W (scale) %»W Pffifc 

[0037) BB#J&S<?h/M£iaaS2 2 0fc*&ift3 

iuuaa » t j n m , w 1 n a&ctq 3 0 

^BffifctfdST^aTft-^STfci. 
ayD-y^^ift^^h/Kdx. dy) IteifcO,}:? 

[0 0 38) $U.<Oi'—?yzfrt,h1>>bXolZ. **> 

$*<.iT£>S. MPEGx—Jr^tai/tte^flra 
li&OilOT**. 

[0039) MPEGy-ir^J^Lft«l*iiI/b 
hh i ? C . B« . B* i*frf3gfr £ fflglzmi 

it. B a mroz 1 s t«aLT ^afcMHfc t 

Pi.OUt^h^iSSoTfil^^h^ 
J: !) t;SStti»»V\ Be > B^ HMUMZI 



# 
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i . Br, . B, (D&&i±I^mVi± Or < *T W m* 

[0040] *»9jj=3sv>T«w-6*iSi. i mm. 

ffifCDiSS'jBl^f® {backward prediction) ^fr-sfeBB 

[oo4i] i: *i*ifc«»fejnattofiffl 

7 * iWQMrvt d 7u -y 9\t1E$i£.~? 9 
Tt«rV». ^t. ffiiSBS®w»#<^h;Wifc'tt 

IHHWi. S3WSWC1IB ( x . y, k-1) tift 

MB (x, y> k ) tt^EttS*.? r-A-£ 
3 fc I ffifcov? d?d »/ ? £3jrf\ *EpJi 
r-Tt^fiCMB 1 . MB 2&£&U:«I<0i} 
S^h/MMN/Mi'h MB3«ffiM^Sl&#'S^r- 
A**l/0»*£l:jWlfch.*. 83^**331. MB 

—°7vtt?\± I Ofcfif J: IT &tt»V>£ L i e J: *) --^m- 

X\ ffl4i£7Kbt:£o&W~3<mt&izftmt&. ifc. 
Sl^l-^ldx. dy) tgiL. mZ'VrhA' 
exxmmoi. o tz&bhtWt* 34 fciSU:* 5fc 
2e±. *±. ST. £T<7)mw*Mzftm2tih. 

[0042] 

[»4] . 

[0043] ili{fecoS)^<^ WWi^oi^ic^^ 

?MB (x. y/k) 9. sS§f? 

©ifai^HRLfc Blifttfr? ? 0/07 

1- - n. . . 1., 1 TttMB (x. y, k) 

■tM*osRR*s*u <u = ft)., ajT mm 
few. ifc^i 3 ^fx* . 

[0044] 
[&5] 



{0045] Tte^Jf (transpose) JJg^T' 

[0046] 
«6J 



Wk)) g 



[0047] 2 : xtt. ytt^fx-fflODllSd*) 



{0048)£g_3_: BSSrlnaiffifc LXm 



[0 04 91 ltr»Ufc*J603%— ?T&AZtdzzir 
1 0 0 5 0 ) 1 2 Oli. 

»a&fS. BS^VrtoM-zUHtt. TU>( (arra 

[ 0 0 5 1 ] W>£<? h)U7 4 -}Wtf&J&.Ztdx& . 
SKMBBifejSK 1 3 0 JOS^<^ ^ K«E£S5 

i20iz^m^tix\,^ip. tnx t<.im< 
?Y>],y<-}UYiz^xm]iR%^*m\ mm 

mutism®., tjxj-&.v/£iiimkm$*.mz 

/'^^SBff^SS 1 0£rtkV/S3ttS«&& 
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5 3 0. ■£iffi7W®W J &g£M 540. £j£&iti&® 
$m&M5 5 0 &l/^t£*TI&M&?S£l85 6 OiiHl 
lZiikLfZ±#&£sm 1 4 0 . 
[00523 06 £lS/ff ikS&i&E§E 500 ? )liifE£ 

. »/ffifctI&£fc5EgP 5 0 Ott*^? < - 

(d„ , d„ ) #(0. 0) ^V^D^O-y^O 
BRONjoJ&tWt (Sfl6 0 0) . ^*77n^D7 
7^ »Nu , fcgfgttitf (KP86 10). gpg6 
2 0 rirff£iii>it^a J J2*'0£ 0 T,& S . 

C0053] 

1*7] 




[0 0 54] gpg6 3 0C*SWt\ #^,fu^g. ffiffa 
ff»S«fc55rS. Te.= [0. 0,1. 0]-, «iHT 

a_=o. 9 =5: £ . i o %]$±tfmmm:h 

c0r-^li-&^l»jtH«^S5 3 0- f \A*?*t-5 l . * 
tit fc^MNcTSliaB^^BJS 1 O'VAflSftl,. 
-4 0055) ★T^MTtt MBfe gg 5 1 0 feflfil 7 fc 

smmmm (fusion) ?iz.b*m#>'zmL< 

BJM^v^fcSiLTtil 0* (minutes ofarc) 

*KfcLTtt6 , OSttBSMWs-*-**T**a*, B* 
«8»fS#liltf*v4f*MEfc tT«2-0'ic*-5Ti» 
fcfl»3*l*:. «-»T. 8fg7 0 
Ofc&tYO*. 6'&iiL2 0'4>8BrtaffiSafl** 

taggBWWffrat). B8omi(B»Rv4itf%<ogM 

fciOIWSfU. (*»7i 0) . 
[0056] 
t»8 ) 

[0057] 5 v<JDHfiid% (minute) tttoTBL <degr 



ee) TWctf>fc:S3:6 0TfJ4^£T2b4. Lj^JLft 
cmT*S6. 

[ 0 0 5 8 J Ljti^*T3»*ite&f*fM!*ffl5 . 

h;*agglfrSr d r ffL„J: 0**v^McTv 
?P7 , P-y?<P(fflftT'fe& Nt „ S-gfgL (gfg7 2 
0 ) . Ni. v SS£Nii a ^ ifcga . aatttBBtfc: J: Off 
ftStfl* (&f§7 30) . 

[0059] 

[»9] 



1 0 0 6 0 ] <> U a „ flTMHITv J: 9** fthtfl 
fcajTfS (gpg74 0) . 

[oo6i] ^m&#*ymsi)&v¥bii 3 mst&o 

*>. mizizk. ^>?v±«amM(^wKBii0 
* 4g£8#x». <r«affetar. is#o*£. #jh««t. 

^5»±«ssr(io. osteu. a^sMwarctt 

0 . 1 5 fcf* . 4>li»*<? hA*« 

HUTi^StftBflWf-^IMcTlbWMttiiS 3 0 
•N&fcSii* . *±ik i*¥/S3»Ii«fc}£SS5 2 0 

[0062] *¥/&S®Jli«&5t£l5 520 «A#Sc0 

mkfcJihJf. rtc^FMBMHl 0 » te SQjgll (negati 
ve parallaxt/ciicrossed disparity) tC*$WCliB&2 
7'T'* I 3^ (positive paral laxt ^fiuncros 

sed disparity) lZ&\--Tl±24'T$>h. iKj2g. > <0^H 

g<^m<£T-{±BS4 . 9 3 • Tft 9 . IBO&gfcfcU 
T« 1 . 5 7 * j6»/JB04*tWE*««T* S-Sfr^T 
*ftit**8E^Siut. gPt9 0 0fcfcwn±. iO* 

T»«J:5fc«ft^ft4 (®l^9 10) . 
[0063] 
[RIO] 



# 
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£„<-2-r>-tan(4f )-(^|) 

[0 0 64] zzx-. mij^mtxtv-ytx-om 

m&tcmhz; OC* 9«fcftJ4A3WlfcfcfcS[ 

-jT, Una £ fufc LaJiifco J: 5 ti^fc i>ti& (gpg9 

10) . 

[0065] 



[0071] 

tai3] 



[ 0 0 7 2] £ CT, -NfciStffBflWTd x#0T4n 

[0073] 
[S14] 



! [oo6 6]ina«w J _to iJ2 _*»o. 5^g, saei yg 

J:-SL« l :£Z-3<0( g(l .5 7' . 4.9 3* ) <a¥fe)<BT 

[0067] #vvj\ m/ms&mmms 2 0 a, 

#d x<0fft»«*»Laj.J: ZTGEMm+l'V? ay 
Py^Qg ftNt » £ff3EL <gpg920) . N,. H fc 
^n?n.?? (1 &N„ , fc Wife* ajjji. 9 3 
Otefcvvc«oBy5*fflvvr*a&Mi4 . 
[0068] 

ran 2] : 



[0069] gP£940fcfcWC, fcL«ajWWr*3L 

o *a mm t »x.z*u * i x-zmxK 

«aiUU:ft£?*l«. ££T. Th_«0. Oil. 0 
^jSSS»li«^«5 50^ifSI^)Stffi«. 

<o%r&. £f$mg.m$>m&%.&.M 5 6 0 *mss«co± 

7k J F/^ti&Ii&&£§? 5 2 0W9lttKfra*)HUHI 

5 5 oixfeti&¥IWra£* 5 6 0 9) 3 *>!£igSS 

[ 0 0 7 0] m 1 tt«^qMHft£iF5 6 0S-S& 

ff=H£«5 6 0tt3ttMC*tf tTOOWUtt&jtt 
«*SliigK$-f{-S-ri» (SKI 10 0). ¥*iH!3 



dtnx — max ,- V«l, i= 1,2, ... ,.W 
[ 0 0 7 4 ] fcvvr. £j£*?ttBfta£« 5 6 Oli, 
SHI 1 0 1 (c*$v^T?fi£iffttci5-f tSEML ttc 

i. z<mmi i o i fcfcwrtt. t-rwrk^. :s mim 

W&Z$3£t.&. 09<^>m9 1 OXTSUbKLMjtm^ 
T£.mmtt&t2>fcZ>Mi. gOTO* (previous f . 
rase) Vo-h-^Zmm^X-hh. ZhZ&fetl 
fcti>(3£SBBR (delay factor) «rWW4. 5I»3£ 

(the left eye) fcilR (the ri&t eye) CjjrfA.^ 
Th&tf. mEW&tZii^X^&l&m£- : &t2>K1& 

-Wfmmmmi. wee s # v - 7*£iBm x. , & fi\ i&t i 

»V^3«hyfe*.-afc»fcfcIv fcU £[tTBft 
g- K - . (n=l. 2 «) t^S-fS. Sg 

«SrSix, an*ujst<te«-*jainwRfeaus. ms 

[«15] 

/o— ROUND I-^H 



dx -ttL» t ZfL^trZ*) /Jn$ v ^.<0T-> f n <0* 

/|v«ilT*6. ROUND [] <sE^5LAMS?T-J) 

[0075] £l«IVCK^ffiH^:K>tc(i^ * D 



( 2 6 ) 82 0 0 1 - 1 6 6 0 9 ( P 2 0 0 1 - 1 6 6X 



[007 6]gPSll01tf^73ft*t.lf. 

ihis&±3 5 6 0 i±fc¥ : mr$-im&@&£.f£-?z> 



t, ^e-FBjfciw-*) . &rwmmwMt. 

F A I %- F B ££yrf* £ liffitf>T*¥*fS3ST£, 
5. 

[0 0 77] =E-FA£fcfcfrE- FB<jO%g£ &2fr l,> 

[0 0 78] 
(S2 ) 



[ 00793 
IS33 



[00 803 
[1514 3 



si 8s as si 
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i omemts^m&zixtefti^&Mmm 
a. 

c o o s 2 ] m 2 <o»M*;R^?fttt%4>Ba 

O^Jzt-FAfcS.fc. 2 ) #j*7£g!Bfl&3 ) %ft 

aeaB4 > ^«c£{si®te. 6 > ^^^tffi^ucai^* 

£{8BIt&7 ) jft* 5 SjgJW&tffeti&fflBItt 9 ) 

, 5*flra&z^#£*fflBi» 1 o > a * y&§mm 
s. ££, ^ j< ^ tfM®mm>w&TWk<7)m3s&tc^tt 

fc^-FAESRU ^9tftfeMHMBirgWlB>Mi 

[0 083] 01 1070— f-^-hORBSteRoT. 
SKI 1 0 2fc4JV^«ffiB«4-<ttfejefW (Priiar 
y Dm - lMlui Are* , r PDAj fcf fr^ S ) 

(SecondaryDecision Area :-JStT. r SDAjtS^" 
6) (tdMBSti*. -«8We«« (PDA) I2B1 2fc* 
3*lfc«B»«*fc»V^Trt«roi»[rHX. (1-r) 
NX] x (rHy. <l-v ) MtMCV>fcfHtrfci). ~<K 
ft5£«« (SDA) tttrMX. (l-r)Nx) X [rNy. 

(1-r) MflWrfe*. v«OKBttC0.0. 0.51(3* 
f 4. PDA}i^y^51Sfi?-^L, SDA?li*.X9Rlffl( 

[0 0 84] A* 550i*f6]Sr^t4PDAtfl?t4v 

jE«i?9fc*LTH*. SKI 1 0 3 tcfcwttf 

2>. <*V>T\ Jl04?#oaR x OO^cOj^&l/jEO 
^SXffifcfcff*** (SKI 10 4) . i«H 
ft-eflPDAlO], PDA(l). PDA[2) Z<7)WM& 

D7D -y ? ?Xmk m-Th&. PDAKh PDA 
[1). PDA(2)£&UT-#(l^£l^£Ppilill> 
(SKI 10 5). ]JL.s(0. U 2h ijjimit 

r*j. "Oj. r-j^^*,-- pt^ts. £«o*SJ|!2& 

T'SK 111 2 (Cfe^.T-Sfcfti .■ 
[ 0 0 8 5 ] SKI 1 0 6teavvcSM#SBRS*l*. 



#<?F;l^*¥{£frO^£#?It4 (SKI 10 
6 ) . fcuTSO^soffiBa, 0iM?*O{i!aai^EO 

a^n&frfttr-r* (ski io7> . z<?>mim 

A(0), SDAtth SDA[2USfc&. Zil^QjbSDkd* ) 
2r^V^2S'?O2(lc0do-#^OiO^Sy : SDAil 
(SKI 108). £L«S2:frflU:J&t> 

[0086] SSlfc. &l1}fik&2lTmiZ.&fhm. 
aim r* n ft tftfrOSBfcfc.fc>)fta:3ftS (SKI 1 
11). 
[0087] 
(81 6 J 

_ SPAK1 
rsl " SDAtri 

[0088] SP2fc, SDArt<0* ;s FE!S(^Nx. (1-r) 

9TfW) OJWZaJiRKl 1 1 0T'»<0S^SrMVv 

[0089] 
{»17] 

{0090]SK111 2tc*5V>T. t Lt« p , ^-ES 

■^ierr±'?^<, r.»i tyttmam?*!*} 

«3ES*<. *fLfcfcJ|l2*rtH±«3*l«!Ifci»)«*a 
i^>fl2>. ^2^i6j*i r+j (*Mffl6) SrfS-fo 3 . *1 

r -J (^ffiH^b) mff52Wlifi r 0j (fp±« 
S) ^*Sf t^-HA^Stf^ fficD^TO«^{i*- 

• [0091] i}&ft7k^$jw&%£B s a on. mm. 

1 3tewS#tte7to— fsr-h^KViTBHW-*. SK 
1300te*}V^T. ttykWtWs&Zt&k'miZ 
ixhli. mi K0SK1 10 54»A.#Mi**l*H!I* 

a*?antt*nfc3WtL (H»i3oi> . ^x^ai 

(SKI 3 0 2) . A^ymn30\^ri-79uru 
v^fctiH-^rSO (positive) MM 1-4.1. 
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%h%. -v^nra-y^ttO^^S^iiffig^JOIE 

8*t(J8Wl30 9) . i*JSM®tf&3$.2t\Z (ggi 
310) . S©1 3 00ai/S^13 04fcJ:!?^^7 

ftf. f?ih#J[RO-?:?c7n-y?teR— $:IE02U^4 

31!67?Q7'D-y?4C«i0O^t4-i4 (SBl 
305) . SJfgl 3 0 9T(iJ|M®t*»f ; ?^orD77 
£t*V£9tt£*U SVl 3 1 

8!$13 0 0&tf8Pgl3 04fcJ:9 

A'fciEEU (SB! 3 0 6). jEVarttX^ 
*fctf>Xy*; (edge) ffi|»JBVi«. SPgl 3 0 7fc*J 

[00923 1 ) *>jt jmtttti &Mfrttntoim i 
lOgpgl lOSIcavvtKHUfcSJfrcifc**. 19 

u~?u»,9<rm% K9 vwfrsmfttftjt jsmym 

9KB ( n, a ) ff Mt<9. J-fm'bWth 

&£i±m m <ni -l. n, ) < aag<* h^fita?^ 

[00 93] 2) 7;D^D7?TlirJWtWt- 
> u • / crv^rtr) \ ) 4 Ml r6 x 1 6 f fc ft /!>\ StPBS B • 
MUTv^n^n^OXy^OSqaEtW*.*. 

V». X y itfflFttUTr 1 . T2 ; T 3 . T4 fcgWtr$- 

X »/^MBTft-5TX y yKBfJl y ittAttTf t »' IK 
y-?? d/d?? oSLJbOv;? n 7o y 
*f 4x7 i/-?9 D^b y? arfflv^4 . 

(00943 3);** ym&T'it mm& it. mm 

ZZX. MAX ( du a ) ti^fcg* r> tZ&tWt&mco 
•79 n fn y 9 <vm&yju^e>&*i& k tsixi . 
[01013 SPil 3 0 8{cfcUT£f3t:*i;l> 

x 7 V S-Sv ^K#S fiSr^fiUi^ia 9 T2> * . 



SJiiair? 9b7xd?9 <r>1b% <9 hlVr^Htri . 
[00953&PS130 aTli;!!)*^? h/t'ffggCSg 

Q7oy;?Ol&#^? wmt*¥rt»fcMd£flJ: Offl 
««*iTV*ft#. gl&»ttaft8teS«K-j-&l8fcg 

aKi-fcib hfrt:* 3 ?$g@£Simt1>. ill 

»a5-tl<-^)t^«&#^ f;u;7) y;UA (no™) d 
4. 

[00963 
[»183 

JJE^fc&^Tdxi^i^oyny^i&fc^;? h)U0 

[00973 
[R193 

rf MB <=MAX (frfj.lrfj) 

[00903 ^— 
[»203- 

[00993 ac^^^^i^fcii^TOV^nrn 
v?tt»te*TO«UTtl!B«*|jW*. log- 

[01003 
[»213 



[01023 
IS223 
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J5*( «i. »z) = \ »|.»2) + ^i-l(*l. «2> + 



[ 0 1 0 3 ] a\± (n, , n, ) tC^&^P 

7"n -y 7 k (ni -i> n»-l ) C g-r&v^ n7o 7 ? 

zrtmrttVOXAbl* 4 51*41/2, 9 0fiKf 

C. PxKtj3BgaHM>afflK$. PxK-HiiaWWR 

[0 104]ra«fc. BWl309tJ:"3fflH»f»^ 
?nyn 7 ?J'*™U (SKf 
1310). 

[0105] •&j£Ba»Iii6f&£SP5 5 OHSSBSgEtf 

Bl 5 0.0 ) . ttttSftfcCfl^ffafetiSRri 5 0 
4 Tftfcit* . Wfc<?>±XW9 n7"Q y ? O 5 ^>&*: 

v*$v?o7*oy:?«8iiij-$-i> («wi 501 > . 

LH.ta#mi.* (SKI 5 02) . £«LH««»« 
•aj7?o^Ov?t*WW4 (&PI15 0 3).* 

*i^ja«B«t-frjwr* (SB 1504). 

[0106] £j£i?itM&3££& 5 3 0 li. 3W 
»jh#&k ft*U»±W10Afl^T£#KlL- 

mti am i 6 00 ) . /wi^wto. 2.553 

OESBIr^rf 2 56 5rN^EBIK:^-i-ft^* 

IW U^SKSKiat^at-i (BW 1601 )-. * 

*#<"*;L fcW5ir*SflHKsl>*<*£* (8»JL 
602 ) . *SflM*fflvvcOT**¥21t=SStt*. 
(gffil6 03) . K*T*»Ci9#7*n7 r Q'y* 
fe* 3 P9»tT**Mt4«i-4 (CUtl 6 04). 

[0107] zy^imfc&im 1 5 6 

»1 4 0«oai**»4>a2*V>LR4TK88Lft*^S;« 
6 0 tiffl£ Lfc i I lz±fcgg£]&M 14 0 tt&ABft 



«fefcWS8*l«lM«a«<^*. MCI 70. 180 
!±3E/£tlB / &&^ 1 5 0 *» ffi* SixS S/*fflH 

[0108] 153* UfciSSHST*-*— Cf <f 

P E G«9&#3Qfta&b Oftft AOllffRC J: «5 »± 
ML MifHI. ^2SM«tJ 

P'EG£ffi\rV&MP-EG2-HDTV. MPEG2DV 
M'PEGlk*T*CD*i'fcffiVVC;i# 
^W^Ifilfc^O, MPEGfcffllvtVvfrnNTSC 
TV.'VCR«r4r(Ct«i*. MML. «fttt*J8V* 

BRAff fc 1 SB LX±ftXW&*m,-*?> Zbtzi. 9 

— = 



[0ffiOffi**&«3!) 

[91 ) *%HHV3L* U^S^SfciiMPEGT*- 

[®2] bA'^Meommwk^m-yo •/ 

[S3] ia«^^D7*D"/^tcS*4BS«-7j?n7* 
[04] IiHB«l6*'<?h***3Et*fc«>fc***«. 

[B7] *¥iMfek3E*¥SEfeS gSt1-37P-^ 
(538] ft±jt^jgBiSM^^kft±git«^>^HflR^ 
[H9] ^mim&z:3&>Z>y°-i-*-i-X'ftZ>. 

[011] *?«lfetrS:*?fe(6fcSESrt-45^)7a 

[si2] wmm 
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IH1 5] !KMlft*iiW^fc^r4*»)7D 
10 0 WRJftfflS 110 



klPEC 



100 



no 



120 



120 ftS^Mu^-zusuusg 



140 



150 &fifflftffittff 
8 0 DAC 
[#gE*flE2] 
[fiiIEftl£g»£] ®M 
Hi}Eft*giB«] 01 
[*£Efr&) SES 
[ffiEWSJ 
[HI] 



t 1|0 



140 



cm 



150 



180 



♦TdacW 
170 



130 
150 
170 



16b 



mm 

■MBErt*} 

[03] 



fMBSlxjrjl^ir 




J-J UEItxj.k-1) 



mmtgt&mz,) mm 

■HffiE f ftB H- — • ■ 

105 3 
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12C#S 



4. 
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S 




510 
< 




520 
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s* 
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fcSHfc 










tt3E3B 



J 
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j 1 


! f 




540 


! 550 , 


i 560 





-t 1 



{06 1 



c 



&9*ftT o 600 



I 



1 *»»gyPy»oaMN>g)»WT fr -6»0 



[»3E*f*iIi=&J 07 - 
[073 

C ■» ) 

I 



g» (o» »g 



r--730 



T 




I 



Mfp^rr^=y. » p -/p * a»fl>liwft« I -— tot 

H-K /flfn* »r» oov 



tf* <Oa) ti* 

7 



(aw) Q*ra« ) 



miEM&w&z] mm 
c«E««JSs*)ai 1 

[SfiEfr&J see 
[011] 
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BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 
ElFADED TEXT OR DRAWING 
aiiLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

O LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



